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USE  OF  THE  ASHY  CLASSIFICATION  BATTERY 
FOR  COUNSELING  AND  ASSIGNMENT  TO  NON-ARMY  TRAINING 


Project  TRANSITION  is  a  unique  and  ambitious  program  of  cooperation 
among  the  Armed  Forces,  industry  and  labor,  and  a  number  of  federal  agencies . 
The  goal  is  to  provide  soon-to-be  veterans  with.  Job  training  and  thereby 
help  them  find  productive  futures  as  civilian^.  !  The  project,  established 
by  the  Department  of  Defense  in  19^8,  is  adminis tiered  in  the  Army  through 
the  General  Educational  Development  program  in  ArW  Education  Centers. 

^Four  basic  services  are  offered  to  men  and  women  being  separated  from 
the  service:  counseling,  training,  education,  and  job  referral.  Enlisted 
members  with  six  months  or  less  of  active  duty  remaining  prior  to  separation 
or  retirement  are  eligible  for  TRANSITION  assistance.  1  The  TRANSITION  cycle 
begins  with  an  orientation  session  explaining  the  program.  Individuals 
then  complete  a  Career  Plans  Questionnaire  Indicating  their  background, 
future  plans,  and  aspirations.  Those  requesting  TRANSITION  services  are 
scheduled  for  individual  counseling  sessions.  Graduates  of  the  training 
courses  are  not  guaranteed  job  placement,  nor  are  they  obligated  to  seek 
employment  with  the  company  that  provides  the  training.  But  since  industry 
(and  the  government  agencies)  normally  provides  training  in  skills  for 
which  it  has  job  requirements,  those  who  successfully  complete  a  course  are 
usually  offered  employment. 

vIn  the  Army,  implementation  of  Project  TRANSITION  focused  attention  on 
the  proper  referral  of  applicants  for  TRANSITION  training,  fj  At  the  time, 
the  Behavior  and  Systems  Research  Laboratory  ( BESRL)  advanced  the  position 
that  a  suitable  aptitude  area  of  selection,  based  on  Army  Classification 
Battery  tests,  could  be  suggested  for  each  type  of  TRANSITION  training 
without  the  necessity  for  additional  prior  empifical  research.  The 
Department  of  Defense  (DOD)  and  other  Interested  Industry  and  agency 
representatives  concurred  on  the  acceptability  of  the  ACB  and  other  Form  20 
data  for  trainee  screening^.^However,  in  order  to  provide  an  empirical 
base  for  the  use  of  the  Army  tests  in  Project  TRANSITION,  DOD  requested 
BESRL  to  undertake  a  small-scale  one-time  study.  The  study  was  conducted 
on  students  in  the  IBM  Office  Equipment  Repair  Course.  The  present 
Research  Memorandum  is  a  report  of  the  comparability  study  of  ACB  tests 
and  the  tests  used  routinely  with  civilian  applicants  for  the  course.  A 

,'ri 


^Maurer,  CPT  Richard  C.,  USN.  Project  TRANSITION- -Bridge  to  the  Future. 
Army  Digest.  2*.  10,  October  1969. 

^Memorandum  from  OSD  (MSeRA)  to  Dir,  USABESRL,  dated  13  March  1968. 
Subject:  Equivalence  Teatlng  of  Army  and  IBM  Tests.  (Appendix  A) 


BESRL' s  position  was  based  on  extrapolation  from  experience  with  the 
operational  Army  classification  and  assignment  system  and  the  effective 
differential  validity  of  the  Army  aptitude  area  scores  demonstrated  over 
time  in  a  wide  variety  of  Army  training  programs.  Examples  of  aptitude 
area  composites  and  cutting  scores  suggested  by  BESRL  for  certain  TRANSITION 
courses  are  shown  in  Table  1. 


Table  1 

APTITUDE  AREA  COMPOSITES  AND  SUGGESTED  CUTTING  SCORES  FOR 
SELECTED  TRANSITION  COURSES 


Course 

Aptitude  Area 

Component 

Tests 

Suggested 

Cutting 

Score 

IBM  Office  Equipment  Repair 

General  Maintenance  (GM) 

PA,  SM 

100 

Television  Repair 

Electronic  (EL) 

ELI,  MA 

100 

Postal  Clerk  Training 

Clerical  (CL)  or 

ACS,  VE 

90 

General  Technical  (GT) 

VE,  AR 

100 

Correction  Officer  Training 

General  Technical  (GT) 

VE,  AR 

100 

In  the  case  of  the  Postal  Clerk  and  Correction  Officer  training  courses, 
the  concern  of  the  training  agency  was  that,  even  if  training  were  completed 
successfully,  the  Post  Office  Department,  the  Federal  Bureau  of  Prisons,  and 
the  Civil  Service  Commission  would  require  TRANSITION  graduates  to  take  the 
same  tests  as  are  administered  to  untrained  applicants  for  employment.  So 
strong  was  the  conviction  that  these  graduates  would  be  suitable  that  efforts 
were  made  to. have  the  Civil  Service  Commission  and  the  federal  agencies  to 
agree  to  accept  them  without  additional  testing. 


COMPARABILITY  STUDY 

The  study  requested  by  the  Assistant  Secretary  of  Defense  (Manpower 
and  Reserve  Affairs)  was  to  take  the  form  of  a  comparison  of  the  ACB  tests 
and  tests  routinely  used  as  selection  instruments  for  jobs  in  one  of  the 
occupational  areas  for  which  TRANSITION  training  is  provided.  The  Office 
Equipment  Repair  Course  offered  by  the  International  Business  Machines 
Corporation  (IBM)  was  selected  as  a  test  case  for  comparing  the  effective¬ 
ness  of  ACB  tests  and  the  selection  instruments  used  by  the  training  agency . 


•  Tin-awl 


MiMI 


It  was  the  intention  of  IBM  to  use  the  ACB  measures  only  as  a  pre-screen 
and  to  screen  additionally,  first  on  an  evaluative  interview  of  potential 
as  IBM  field  representative,  and  then  on  several  IBM  paper-and-pencil  tests. 
The  tests  are  described  in  Table  2.  However,  before  the  data  analysis  was 
completed,  the  BESRL  position  that  the  Army  tests  have  a  direct  value  for 
predicting  IBM  TRANSITION  training  outcome  was  accepted  by  IB!#'. 

The  equivalence  study  design  provided  for  the  prescreening  of  Project 
TRANSITION  applicants  for  IBM  training,  using  a  General  Maintenance  Aptitude 
score  of  100  as  a  preliminary  standard.  IBM  would  make  the  final  selection 
on  the  basis  of  an  interview  and  scores  on  its  own  selection  tests.  IBM 
test  scores  and  course  grades  for  all  individuals  who  started  training 
(including  those  who  failed  or  who  dropped  out  for  non-academic  reasons) 
were  to  be  used  to  determine  the  validity  coefficients  of  the  ACB  tests  for 
comparison  with  those  of  the  IBM  testd1'. 


SAMPLES 

Army  Sample.  The  2j8  men  in  the  Army  sample  were  tested  with  the  ACB 
and  the  IBM  selection  at  Fort  Dix,  New  Jersey.  Armed  Forces  Qualification 
Test  (AFQT)  scores  were  obtained  from  Army  records.  This  sample  was  used 
in  correlational  analysis  of  the  two  sets  of  tests. 

IBM  Sample.  The  IBM  sample  consisted  of  73  civilian  trainees  in  the 
Office  Equipment  Repair  course  at  Endlcott,  New  York.  The  men  were  tested 
on  six  ACB  tests:  Verbal  (VE),  Arithmetic  Reasoning  (AR),  Pattern  Analysis 
(PA),  Mechanical  Aptitude  (MA),  Shop  Mechanics  (SM),  and  Electronics 
Information  (ELI).  Final  course  grades  were  obtained  on  each  of  five  aspects 
of  training  performance:  laboratory  performance,  subject  knowledge,  attitude, 
key  punch  technical,  and  key  punch  personal.  Total  criterion  score  was  not 
computed.  IBM  selection  test  data  were  not  available  for  this  sample.  No 
direct  comparison  of  ACB  and  IBM  test  validity  could  therefore  be  made. 


RESULTS 

CORRELATION  STUDY  IN  THE  ARMY  SAMPLE 

Correlation  data  is  presented  in  the  form  of  a  12  x  17  matrix  of  the 
AFQT,  the  eleven  ACB  tests,  and  the  five  IBM  selection  tests  (Table  3)* 

AFQT,  a  test  of  general  learning  ability,  was  included  in  the  matrix  as  a 
reference  test.  AFQT  contains  four  item  types:  Word  Knowledge,  Tool  Knowledge, 
Arithmetic  Reasoning,  and  Pattern  Analysis.  For  ease  of  comparison,  AFQT  is 
listed  with  the  three  ACB  tests  of  general  ability:  Verbal,  Arithmetic 
Reasoning,  and  the  General  Information  Test  (GIT).  These  are  followed  by  ACB 


LTR.  IBM  Corporation  to  OSD  (F&RA),  dated  24  June  1968.  (Appendix  B) 

^Memorandum:  From  Dir,  BESRL  to  OSD  (MfcRA),  dated  l  March  I968.  Subject: 
Determining  the  Comparability  of  IBM  and  ACB  Tests.  (Appendix  C) 
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SCREENING  TESTS  USED  BY  IBM 
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tests  of  specific  aptitudes,  knowledge,  and  information.  Data  on  the  ACB 
Pattern  Analysis  (PA)  and  Shop  Mechanics  tests,  components  of  the  General 
Maintenance  Aptitude  Area  suggested  by  BESRL  as  the  selector  for  IBM 
training,  are  listed  on  adjacent  rows. 

None  of  the  correlation  coefficients  was  high  enough  that  Army  and  IBM 
selection  tests  might  be  considered  to  be  Interchangeable  or  equivalent. 

The  one  possible  exception  is  the  correlation  of  r  *  .76  between  the  ACB 
Arithmetic  Reasoning  Test  and  the  IBM  Aptitude  for  Engineering  Test  (AFE). 

The  AFQT  and  six  of  the  eleven  ACB  tests — Verbal,  Arithmetic  Reasoning, 

General  Information  Test,  Classification  Inventory  (Cl),  Army  Clerical 
Speed,  and  Army  Radio  Code  Aptitude--had  their  highest  correlation  with  the 
AFE.  The  five  IBM  tests  were  most  similar  to  AFQT  (average  r,  .55)*  PA 
and  SM  were  relatively  independent  of  the  IBM  selection  tests  (PA  average  r, 
.46;  SM,  .29).  Thus,  the  GM  Aptitude  Area  and  the  IBM  tests  may  not  be 
measuring  similar  aptitudes.  This  aspect  of  equivalence,  however,  was  no 
longer  an  issue  by  the  time  the  study  was  completed  (See  Appendix  B) . 

On  the  assumption  that  pairs  of  ACB  and  IBM  tests  with  similar  item 
content  would  be  measuring  the  same  or  similar  aptitudes  and  would  there¬ 
fore  correlate  higher  than  would  dissimilar  pairs,  the  tests  paired  as 
shown  in  Table  4  were  examined.  While  from  inspection  of  the  content,  only 
the  ACB  Pattern  Analysis  Test  and  the  IBM  Survey  of  Mechanical  Insight 
appeared  to  have  similar  item  content,  the  paired  tests  yielded  the  highest 
intercorrelations  obtained  across  batteries. 

Table  5  presents  the  means  and  standard  deviations  of  the  Army  tests 
(AFQT  and  the  ACB)  and  the  five  IBM  selection  tests.  The  Army  tests  are 
listed  in  the  same  order  as  in  Table  3.  The  IBM  tests  are  paired  with  the 
ACB  tests  with  which  they  had  the  highest  correlation.  The  descriptive 
statistics  for  the  Army  sample  indicate  that,  except  for  the  Classification 
Inventory,  Army  tests  were  one-fourth  to  one-half  a  standard  deviation  above 
Army  population  means--a  result  which  might  be  expected  from  a  Fort  Dix  input. 


ACB  PREDICTION  IN  THE  IBM  SAMPLE 

The  IBM  sample  data  are  presented  as  a  12  x  12  correlation  matrix 
(Table  6)  consisting  of  the  six  ACB  tests  (VE,  AR,  PA,  SM,  MA,  ELI)  con¬ 
sidered  relevant  to  prediction  of  the  IBM  course  criteria,  the  GM  aptitude 
area,  and  the  five  criterion  parts:  laboratory  performance  (LP),  subject 
knowledge  (SK),  attitude  (ATT),  key  punch,  technical  (KPT),  and  key  punch, 
personal  (KPP).  The  criterion  parts  were  not  further  defined,  nor  were 
passing  scores  suggested.  Mean  and  standard  deviation  are  given  for  each 
variable  where  available. 

ACB  mean  scores  in  the  IBM  sample  ranged  from  125.35  (MA)  to  131.08 
(ELI).  Means  were  one  and  one-half  to  two  standard  deviations  above  Army 
population  means.  The  standard  deviations  for  the  IBM  group  were  small, 
with  a  range  from  9*57  (ELI)  to  16. 85  (PA).  There  was  only  one  GM  aptitude 
area  score  below  100.  Practically  all  the  IBM  trainees  scored  well  above  100 
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Table  4 


CORRELATION  BETWEEN  IBM  AND  ACB  TESTS  WITH  SIMILAR  CONTENT 


IBM  Test  and  Content  Type 

Survey  of  Mechanical  Insight  (SMI) 

Aptitude  for  Field  Engineering  (AFE) 
Number  Series 
Figure  Series 
Arithmetic  Problems 

Office  Products  CE  Aptitude  Test 
CE-1:  Mechanical -Electrical 
Principles 

CE-2:  Electronics  Principles 
CE-3:  Figure  Series 
Number  Series 


ACB  Test 

Correlation 

Coefficient 

Mechanical  Aptitude 

.66 

Arithmetic  Reasoning 

.76 

Pattern  Analysis 

•  53 

Arithmetic  Reasoning 

.76 

Mechanical  Aptitude 

•  59 

Electronics  Information 

•  59 

Electronics  Information 

.24* 

Pattern  Analysis 

•  51 

Arithmetic  Reasoning 

.62 

‘Correlation  between  CE-2  and  ACB  testa  ranged  from  .07  to  .24. 
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Table  5 


MEANS  AND  STANDARD  DEVIATIONS 
OF  ARMY  AND  IBM  SELECTION  TESTS* 


Mean 

Standard  Deviation 

Army  Test 

IBM  Test 

Army  Test 

IBM  Test 

AFQT 

58-76 

23.41 

VE 

110.83 

AFE 

29.90 

20.99 

AFE 

12.38 

AR 

106. 54 

CE-3 

28.19 

20.46 

CE-3 

12.26 

GIT 

103-86 

18.08 

ACS 

104.49 

18.43 

ARC 

105-97 

23.92 

PA 

104.89 

23.11 

SM 

107.81 

SMI 

23.79 

16. 78 

SMI 

7-67 

MA 

107.09 

CE-1 

18.96 

17.92 

CE-1 

6.01 

CE-1 

18.96 

CE-1 

6.01 

ELI 

105.02 

CE-2 

13.41 

18.83 

CE-2 

2.09 

AI 

106.48 

18.54 

Cl 

95.07 

22.79 

*Army  Sample 


TION  COEFFICIENTS  ,  MEANS,  AND  STANDARD  DEVIATIONS  OF  ARMY  TESTS  AND  IBM  CRITERION* 


Not  available 


on  the  ACB  tests.  The  few  scores  below  100  were  almost  all  in  the  93  to 

00  range.  One  trainee  had  three  scores  below  100  (VE  117,  AR  8l,  SM  122, 

PA  87,  MA  83,  ELI  122),  and  one  trainee  had  all  scores  below  100  (VE  76, 

AR  74,  SM  88,  PA  57,  MA  90,  ELI  89).  His  was  the  one  GM  score  below  100. 

It  would  be  of  interest  to  know  whether  these  two  trainees  were  graduated, 
whether  or  not  they  were  employed  by  IBM,  and  how  well  they  performed  on 
the  job. 

The  five  criterion  parts  appear  to  consist  of  two  clusters:  A  homo¬ 
geneous  cluster  including  laboratory  performance,  subject  knowledge,  and 
key  punch,  technical  (intercorrelation  .87)  and  a  less  homogeneous  atti- 
tudinal  cluster  including  attitude  and  key  punch,  personal  ( intercorrela¬ 
tion  .61)-.  The  GM  Aptitude  Area  predicted  each  of  the  criterion  parts 
better  on  the  average  than  did  any  of  the  six  individual  ACB  tests.  PA 
and  SM  were  equally  effective  predictors  of  the  IBM  criteria,  and  performed 
better  than  the  other  ACB  tests  in  this  respect.  GM  predicted  the  techni¬ 
cal  criterion  cluster  more  effectively  (average  correlation  .38)  than  it 
predicted  the  attitudinal  cluster  (average  correlation  .29). 


CONCLUSIONS 

The  highest  correlation  across  the  two  selection  batteries  was  found 
between  the  ACB  and  IBM  tests  considered  similar  in  item  content..  However, 
the  correlation  coefficients  (.24  to  .76)  were  not  high  enough  to  establish 
the  equivalence  of  the  two  sets  of  tests--a  consideration  which  had  ceased 
to  be  of  great  concern  by  the  time  the  study  was  completed. 

Empirical  support  for  the  BESRL  hypothesis  that  ACB  tests  are  suitable 
selection  instruments  for  TRANSITION  training  was  obtained.  Use  of  the 
General  Maintenance  Aptitude  Area  as  selector  for  the  IBM  Office  Equipment 
Repair  Course  was  considered  warranted  on  the  basis  of  the  validity  coeffi¬ 
cient  of  about  .40  in  the  sample  studied.  There  were  no  counter-indications 
to  the  use  of  the  ACB  and  aptitude  areas  in  screening  for  TRANSITION  training. 

The  recommended  score  of  100  seems  appropriate.  All  except  one  person 
in  the  IBM  sample  would  have  been  selected  at  this  cutting  score. 
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OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 
WASHINGTON,  D.  C.  20301 


MANPOWER  15  March  1968 

and 

Reserve  Affairs 


MEMORANDUM  FOR:  Dr.  Julius  E.  Uhlaner 

Director,  U.  S.  Army  Behavioral  Science 
Research  Laboratory 

SUBJECT:  Equivalence  Testing  of  Army  and  IBM  Tests 


Attached  is  a  copy  of  a  letter  received  from  IBM  regarding  equivalence 
testing  of  Army  and  IBM  tests. 

It  would  seem  to  be  most  advantageous  and  economical  to  select  one  of 
the  later  dates  from  among  those  suggested  by  IBM.  May  I  have  an  in¬ 
dication  as  to  when  Army  would  be  able  to  conduct  the  proposed  testing 
program  so  that  I  may  respond  to  IBM? 

I  am  in  full  accord  with  your  desire  to  limit  such  studies  to  the 
minimum.  It  is  expected  that  this  research  will  be  done  on  a  one  time 
only  basis. 

Other  companies  will  be  encouraged  to  rely  on  military  classification 
tests  whenever  tests  are  appropriate  for  selecting  trainees  in  Project 
TRANSITION.  We  recognize  the  need  to  convert  military  personnel  jacket 
information  to  Project  TRANSITION  applications  without  empirical  research 
in  each  Instance. 


CHARLES  A.  ULLMANN 
Research  Psychologist 


Enclosure 
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IBM 


International  Business  Machines  Corporation 


112  East  Post  Road 

White  Plains,  New  York  10601 

914/White  Plains  9-1900 


June  24,  1968 


Dr.  Charles  A.  Ullmann 

Research  Psychologist 

Manpower  and  Reserve  Affairs 

Office  of  the  Assistant  Secretary  of  Defense 

Washington,  D.  C.  20301 

Dear  Dr.  Ullmann: 

To  bring  you  up  to  date  on  the  status  of  the  research  we  are  doing  in 
connection  with  Project  Transition,  data  gathering  has  been  completed 
for  the  part  of  the  research  in  which  Army  tests  were  administered  to 
IBM  trainees  at  Endicott,  New  York.  We  are  presently  relating  the 
scores  to  training  outcomes  and  expect  to  complete  our  analysis  in  two 
weeks.  Incidentally,  of  the  73  trainees  tested,  only  one  had  a  General 
Maintenance  Aptitude  Area  Score  of  less  than  100. 

The  testing  of  recruits  with  IBM  tests  at  Fort  Dix  was  completed  also, 
but  I  understand  from  Mr.  Tom  Houston  that  it  will  not  be  possible  to 
determine  the  Army  test  scores  for  these  same  recruits.  Therefore,  the 
correlation  between  IBM  and  Army  tests  cannot  be  determined. 

For  this  reason  Mr.  Houston  has  offered  to  do  the  IBM  testing  with 
another  sample  of  Army  recruits  and  insure  access  to  their  Army  test 
scores.  In  reviewing  this  research  in  light  of  Project  Transition 
activity,  we  have  concluded  that  it  is  not  necessary  at  this  point  to 
test  another  sample  of  recruits.  The  Office  Products  Division  has  found 
in  their  Transition  program  that  test  scores  of  any  kind  have  been  of 
little  use  in  selection.  The  pool  of  possible  candidates  has  usually 
been  too  meager  to  tolerate  any  further  screening. 


COPY 
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As  for  the  Field  Engineering  Division,  we  have  run  into  a  similar  • 
dearth  of  interested  candidates  and  have  not  even  assembled  the  first 
class  of  trainees.  In  the  event  we  do  get  into  a  large  scale  screening 
situation,  we  feel  that  the  direct  validity  of  Army  tests  for  IBM 
training  outcomes  will  be  more  valuable  than  knowing  the  interrelation 
of  IBM  and  Army  tests. 


W.  E.  DODD 


/jo 

cc:  Mr.  T.  Houston 
Dr.  M.  Maler 


£21 
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CRDBSRL  DOL 


1  March  1968 


MEMORANDUM  FOR:  DR.  CHARLES  ULLMANN 

OFFICE,  SECRETARY  OF  DEFENSE  (MScRA) 

ROOM  3C  937,  PENTAGON 

SUBJECT:  Determining  the  Comparability  of  IBM  and  ACB  Tests 


1.  In  response  to  your  phone  request  to  Dr.  Maier  of  my  staff, 
BESRL  is  prepared  to  conduct  an  equivalence  study  as  outlined  in  the 
inclosure.  We  are  presently  inclined  to  absorb  the  effort  as  a  pilot 
study  within  the  present  program  since  needed  research  resources  do 
not  appear  excessive. 

2.  Should  the  requirement  expand,  as  for  example,  in  replica¬ 
tion  in  other  areas,  it  is  highly  likely  that  present  resources  would 
not  be  adequate.  In  such  event,  request  should  be  made  through  OCRD 
channels  with  indication  of  the  financial  support  that  could  be  provided. 


1  Incl 

Equivalence  Study  Design 


J.  E.  UHLANER 
Director 


EQUIVALENCE  STUDY  DESIGN 


1.  The  following  were  agreements  reached  at  the  BESRL  meeting  with 
IBM  representatives  on  7  February  1968  concerning  the  screening  of  appli¬ 
cants  for  the  IBM  training  courses  conducted  under  Project  Transition. 

a.  Army  counselors  will  prescreen  the  applicants  and  use  a  GM 
aptitude  area  score  of  100  as  the  preliminary  standard. 

b.  IBM  will  make  the  final  selection  on  the  basis  of  an  inter¬ 
view  and  scores  on  their  own  selection  tests. 

2.  The  following  procedures  are  proposed  to  determine  the  compara¬ 
bility  of  the  IBM  and  ACB  tests. 

a.  Administration  of  ACB  Tests 

(1)  Part  of  the  ACB  (VE,  AR,  PA,  MA,  SM  and  ELI)  will  be 
administered  to  trainees  at  the  IBM  training  center  at  Philadelphia. 

These  six  tests  will  require  about  three  hours  administration  time. 

(2)  BESRL  plans  to  test  as  many  trainees  as  possible  during 
one  day,  but  must  determine  how  many  trainees  can  be  tested  in  any  one 

room  at  the  same  time,  and  how  many  testing  sessions  can  be  run  concurrently. 
BESRL  plans  to  have  two  testing  sessions,  one  in  the  morning  and  one  in  the 
afternoon;  several  groups  can  be  tested  during  each  session  if  space  is 
available.  If  not  all  trainees  can  be  tested,  then  those  requiring  the 
least  amount  of  instruction  should  be  tested. 

(3)  BESRL  will  administer  the  tests,  but  will  need  proctor- 
ing  assistance  from  IBM,  especially  if  two  or  more  groups  are  tested 
simultaneously. 

b.  Administration  of  IBM  Tests 

The  IBM  selection  tests  will  be  administered  to  an  Army  input 
sample  of  about  200  men  at  Fort  Dix.  BESRL  will  require  about  200  test 
booklets  and  answer  sheets  and  an  administrative  manual  from  IBM.  The 
test  booklets  will  be  returned  to  IBM. 

c.  Validity  Analysis 

BESRL  will  also  need  from  IBM  the  test  scores  for  the  trainees 
on  their  selection  tests  and  the  course  grades  when  they  become  available. 
These  data  will  be  used  to  determine  the  validity  coefficients  of  the  ACB 
tests  for  comparison  with  those  of  the  IBM  tests.  Criterion  data  will  be 
needed  on  all  the  individuals  who  started  training,  including  those  who 
failed  or  who  dropped  out  for  non-academic  reasons. 
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3.  BESRL  will  score  the  answer  sheets  and  perforin  the  statistical 
analyses.  The  results  will  be  presented  to  ASD(M)  as  soon  as  they  are 
available. 


